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ABSTRACT 


This  is  the  first  of  a  series  of  papers  that  wc  arc  hoping  to  write  on  the  use  of  coritrol  theory 
methods  for  controlling  the  quality  of  manufactured  items.  Such  methods  involve  decision  making 
under  uncertainty  for  a  system  whose  dynamics  are  defined  by  equations  that  are  suggested  by  physical 
or  plausible  laws.  The  emphasis  of  our  paper  is  a  single  stage  production  system  with  open  loop 
control.  The  output  quality  can  be  controlled  via  an  optimal  scheduling  of  machine  maintenance 
and/or  a  switch  to  better  input  quality.  We  advocate  a  simple  structure  for  undertaking  the  above 
task.  Our  hope  is  that  future  work  in  this  area  will  involve  an  improvisation  of  our  theme.  The  key 
virtue  of  the  proposed  approach  is  the  optimality  of  decisions;  its  disadvantage  is  the  need  to  make 
realistic  assessments  of  prior  distributions  and  loss  functions. 

Key  Words  ;  Decision  Theory,  Quality  Control,  Robust  Manufacturing,  Taguchi  Methods,  Loss 
Functions,  Optimal  Maintenance. 

AMS  1991  Subject  Classification;  62N10,  49N40,  49J99,  90B30,  90B90 


0.  Introduction 

A  single-stage  production  system  is  one  in  which  the  input  to  the  system  is  the  raw  material  and 
its  output,  the  finished  product.  A  multi-stage  production  system  is  one  in  which  the  final  product  is 
manufactured  in  several  stages  with  the  output  of  one  stage  (except  for  the  last)  becoming  the  input  for 
the  next  stage.  Each  stage  of  a  multi-stage  system  can  be  regarded  as  a  single  stage  system  and  thus  it 
is  sufficient  to  focus  attention  on  the  latter. 

For  any  single  stage  system,  the  output  quality,  as  measured  by  say  fraction  non-defective,  is 
assumed  to  be  influenced  by  only  two  factors. 

i)  the  input  quality,  measured  in  terms  of  say  fraction  non-defective,  or  some  other  characteristic, 
such  as  material  property,  and 

ii)  the  state  of  the  machine  (or  the  system),  such  as  its  age,  its  maintenance  history,  its  precision, 
etc. 

The  state  of  the  machine  generally  degrades  with  age  and  this  has  an  adverse  effect  on  output 
quality.  One  way  to  slow  or  to  arrest  the  deterioration  of  the  output  quality  is  to  control  the  rate  of 
degradation  of  the  machine;  this  can  be  done  via  preventive  maintenance  or  overhaul.  Another  option 
-  when  available  -  is  to  control  the  input  by  switching  over  to  superior  (and  more  expensive)  input 
quality.  The  latter  strategy  is  not  without  its  criticism;  nonetheless  it  is  used  in  practice  and  currently 
goes  under  the  guise  of  robust  manufacturing  [Taguchi  (1986)].  The  question  of  which  strategy  to 
invoke  and  when  to  invoke  it  poses  a  problem  in  stochastic  control  theory  which  in  essence  boils  down 
to  decision  making  under  uncertainty  [cf.  Lindley  (1989),  p.301].  The  objective  of  this  paper  is  to 
propose  and  to  develop  a  preliminary  structure,  albeit  an  elementary  one,  which  can  help  address  the 

stated  problem. 


For  convenience,  we  consider  a  discrete  time  formulation  of  the  above  scenario,  and  relate  the 
output  quality  to  the  input  quality  and  the  state  of  the  machine,  by  a  simple  relationship.  Similarly, 
we  aescribe  the  dynamical  behavior  of  the  machine  -  that  is,  the  manner  in  which  its  state  changes 
over  time  -  by  another  simple  relationship.  In  control  theory,  it  is  expected  that  both  these 
relationships  have  a  scientific  basis.  However,  in  the  absence  of  knowledge  about  any  physical  laws 
governing  the  system’s  behavior,  the  relationships  proposed  by  us  are  to  be  viewed  as  first  degree 
approximations. 

An  outline  of  this  paper  is  as  follows: 

In  Section  1  we  give  some  preliminaries  and  establish  notation.  In  Section  2  we  propose  our 
model  for  a  single  production  system  with  either  open  or  closed  loop  control.  In  Section  3  we  describe 
a  decision  theoretic  approach  under  open  loop  control  for  addressing  the  question  of  optimally 
scheduling  maintenance.  In  Section  4  we  consider  the  case  of  optimally  scheduling  maintenance  and/or 
switching  to  superior  input  quality.  In  Section  5  we  describe  a  numerical  example  whose  main  purpose 
is  to  demonstrate  the  computational  feasibility  of  our  approach.  The  paper  concludes  with  Section  6 
which  comments  on  the  scope  of  the  development  here  and  prospects  for  its  improvisation. 

As  a  final  point,  we  are  unaware  of  any  literature  which  combines  in  the  modeling  and  control 
of  machine  degradation  and  the  optimal  scheduling  of  machine  maintenance  with  respect  to  quality 
control,  particularly  within  the  context  of  control  theory.  The  closest  that  comes  to  what  we  have  in 
mind  here  is  the  work  of  Barlow,  Durst  and  Smiriga  (1984). 


1.  Preliminaries 

Let  T  denote  the  length  of  the  period  within  which  the  single  stage  manufacturing  process  is 
studied.  Since  we  consider  a  discrete  time  formulation  of  the  process,  we  divide  the  interval  [0,  T)  into 
i  subintervals  of  duration  T/£;  assume  that  i  is  not  too  large.  The  items  produced  in  the  i-th 
subinterval  are  referred  to  as  batch  i.  Assume  that  the  manufacturing  time  of  one  item  is  small  in 
comparison  to  T/g,  so  that  for  all  intents  the  manufacture  of  an  item  is  completed  in  the  subinterval 
that  it  is  commenced. 

Let  wj^  denote  the  quality  of  input  (e.g.  the  fraction  of  good  items),  for  the  production  of  batch 
k.  Let  denote  the  quality  of  the  output  of  batch  k;  i.e.  the  proportion  of  non-defective  items.  Let 
Q  <  <  1,  an  unknown  parameter,  describe  the  state  of  the  machine  during  the  production  of 

batch  k;  is  the  (unobservable)  state  of  nature  with  small  values  denoting  a  large  degree  of 
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deterioration  of  the  machine,  and  ^  denoting  the  fact  that  tne  machine  is  in  perfect  condition. 

Let  6*  denote  the  minimum  acceptable  batch  quality;  whenever  <  9*,  the  production  of  batch  k  is 
considered  unacceptable,  so  that  the  system  should  be  shut  down.  Note  that  the  choice  of  9*  is  itselt  a 
decision  problem  that  we  do  not  address  here. 

Schematically,  it  is  helpful  to  think  of  the  single  stage  production  quality  control  system  via 


Figure  1.1. 


Input  Quality  Wj^ 


State  of  the  Machine 
■^k 


Output  Quality 


Figure  1.1  Schematic  of  the  Single  Stage  Production  Quality  Control  System 


2.  Model  SpeciFication 

Since  the  input  quality  may  change  stochastically,  we  describe  it  by  a  sequence  of  random 
variables  {wj^},  k=l,  2,  •••  ,  £,  with  each  wj^  €  [0,  1].  If  the  input  quality  is  to  be  defined  in  terms  of 
a  characteristic  other  than  proportion  non-defective,  then  wj^  may  take  values  in  [0,  co],  with  larger 
values  of  Wj^  denoting  better  quality.  The  elements  of  {wj^}  could  be  correlated,  and  if  the  input 
quality  deteriorates  over  time,  the  mean  of  w,^,  will  decrease  with  k,  and/or  its  variance  will  increase 
with  k.  Thus,  it  is  reasonable  to  describe  {w,^}  by  a  suitable  discrete  time  stochastic  process. 

Since  machines  deteriorate  over  time,  it  is  reasonable  to  assume  that  if 

maintenance  is  undertaken  in  period  k,  then  We  assume  that  =  1,  and  if  there  is  an 

overhaul  of  the  machine  just  before  batch  k  is  put  into  production,  then  =  (i>^  =  1.  Motivated  by 
the  fact  that  the  times  to  failure  of  complex  systems  have  an  exponential  distribution,  a  plausible 
model  for  describing  machine  deterioration,  under  no  maintenance  or  overhaul  is 

“^k  “ "^k-l  ’  for  k=2,  3,  •  •  •,  (2-1) 

where  /?  is  an  unknown  coefficient  taking  values  in  [0,  1];  let  a  prior  distribution  7r(/3)  describe  our 
uncertainty  about  p. 

Since  9^.  is  assumed  to  depend  on  both  w,^  and  our  next  task  is  to  specify  a  relationship  of 
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the  form 


(2.2) 


\  for  k=l,  2,  •••, 

where  the  function  g  is  such  that  its  first  order  partial  derivatives  are  nonnegative;  this  ensures  that  the 
output  quality  does  not  degrade  when  the  input  quality  and  the  state  of  the  machine  improve.  For 
this,  we  propose  the  multiplicative  relationship 

\  “ '^k '^k  ’  (2-3) 

A  generalization  of  (2.1)  is  to  let  4>^  =  ^  +  Uj^,  k=2,  •••,  £,  where  Uj^  is  an  innovation. 

Uncertainty  about  (2.3)  can  be  accounted  for  by  introducing  another  innovation  term  Vj^,  and  writing 
^k  “  "^k  ^k  '^k’  ^  probabilistic  structure  imposed  on  the  sequence  {vj^},  k=l,  •••  ,  £. 

In  what  follows,  we  suppose  that  the  Uj^’s  and  the  Vj^’s  have  very  small  variances,  so  that  the  additive 
terms  Uj^  and  Vj^  can  be  ignored. 

The  above  set-up  could  be  criticized  as  being  simplistic.  In  the  development  that  follows  there 
is  nothing  that  precludes  one  from  entertaining  extensions  and  generalizations  of  (2.1)  and  (2.3). 
However,  such  extensions  would  result  in  a  consideration  of  details  which  tend  to  obscure  the  gist  of 
development. 


3.  Controlling  Quality  via  an  Optimal  Maintenance  Schedule 

In  open  loop  control  problem  there  is  no  in-process  monitoring  and  so  there  is  no  new 
knowledge  about  beyond  what  has  been  specified  via  t(/?).  Decision  making  and  control  in  open 
loop  problems  are  not  adaptive  (i.e.,  not  based  on  any  in-process  data);  such  problems  are  encountered 
when  it  is  inconvenient  to  interrupt  the  process  for  collecting  data,  or  when  the  cost  of  collecting  data 
is  prohibitive. 

For  the  model  of  Section  2,  we  note  from  (2.1),  that  between  maintenance  actions,  <t)^  decreases 
exponentially  in  k  so  that  for  k  >  2,  ((ly  In  what  follows,  we  assume  that  maintenance  at 

any  index  m,  results  in  a  complete  overhaul  of  the  machine,  so  that  4)^  =  (^^  =  1. 

Suppose  that  the  input  sequence  is  such  that  the  Wj^’s  are  independent  and  identically 
distributed  with  a  nonzero  mean.  Because  of  (2.1)  and  (2.3),  the  output  quality  degrades  exponentially 
so  that  0^  =  wj^.  Consequently,  for  some  k  >  1  and  0-  <  6*,  our  problem  is  to  find  a  k*  <  k  at 
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which  overhaul  is  to  be  performed.  With  open  loop  control,  inference  about  k  will  be  based  on  7r(/3)  and 
the  assumed  properties  of  {wjJ. 


3.1  A  Decision  -  Theoretic  Approach  for  Choosing  k* 

Considering  the  principle  of  maximization  of  expected  utility  [cf.  Lindley  (1985)],  we  present  a 
coherent  approach  of  undertaking  the  desired  task  in  this  section. 

Let  a(i),  denote  the  decision  to  undertake  overhaul  at  the  i-th  subinterval,  i=  2,  3,---  ,  (f+1)  . 
Note  that  a(£+l)  denotes  the  decision  not  to  schedule  maintenance  throughout  the  interval  [0,  T],  and 
that  for  any  choice  a(i),  overhaul  precedes  production  in  the  period  i. 

The  decision  problem  is  depicted  via  the  decision  tree  of  Figure  3.1  with  boxes  (circles) 
representing  the  decision  (random)  nodes. 

Since  the  machine  starts  out  being  perfect,  overhaul  can  not  be  scheduled  at  the  first 
subinterval.  Open  loop  means  that  decision  to  schedule  maintenance  must  be  made  at  the  decision 
node  ID,  where,  we  may  choose  any  one  of  the  I  possible  actions  a(2),  a(3),  ,  a(£+l).  Each  action 

a(i),  i  =  2,  •••,  £+  1,  results  in  a  series  of  consequences  (output  qualities)  62,  •••,  where  the 

output  quality  of  batch  i,  equals  to  6-^.  At  the  time  of  taking  action  a(i),  the  9-^,  •••,  are 
unknown;  let  Pj^(0|  a(i))  denote  the  probability  density  of  (at  9),  under  action  a(i),  for  k=  1,  •••,  i-1. 

The  combination  of  an  action  and  its  consequence  result  in  a  loss  (or  utility);  this  is  in  keeping 
with  Taguchi’s  notions  about  quality  loss  [cf.  Kackar  (1986)].  Let  £.j^(a(i),  9),  i  =  2,  •••,  £+1,  k  —  1, 
•••,  i-1,  denote  the  loss  incurred  when  action  a(i)  results  in  a  consequence  =  9.  In  considering  the 
loss  functions,  an  important  issue  to  bear  in  mind  is  the  potential  loss  due  to  a  premature  overhaul;  for 
any  choice  a(i),  this  loss  would  manifest  itself  with  respect  to  batch  i  only.  i.^j(a(i),  9^,  0j),  i  =  2,  •••, 
i,  denote  the  above  loss,  where  9^  (or  9-^)  is  the  consequence  that  would  have  resulted  had  we  (or  had 
we  not)  scheduled  an  overhaul  at  batch  i.  A  consideration  of  9-^  is  necessary  for  us  to  evaluate  the 
effect  of  a  premature  overhaul.  Finally,  let  Pij(^i,  9^\  a(i))  be  the  joint  probability  density  of  9^  and 
9-^  (at  and  S-)  under  the  circumstances  described  above. 

A  specification  of  the  above  ingredients  -  also  indicated  at  the  appropriate  branches  of  the 
decision  tree  of  Figure  3.1 -is  all  that  is  needed  to  arrive  at  a  decision  for  the  optimal  schedule  of 
maintenance.  For  any  action  a(i),  E(a(i))  its  expected  loss  (over  the  production  cycle  of  length  (i  - 1)), 
assuming  additivity  of  losses  is  given  as 


1-1 


E(a(i))  =  I  Pk(^  i  + 


i.jj(a(i),  01,  0;)  Pij(0i,0i|a(i))  dM^i 


0 
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with  the  last  term  being  deleted  when  i  =  £  +  1.  The  optimum  decision  is  to  choose  that  action  for 
which  E(a(i))  is  a  minimum,  or  to  choose  that  action  for  which  E(a(i))/(i  —  1)  is  a  minimum,  the  latter 
denoting  the  expected  loss  per  interval  of  production. 


a* 


Figure  3.1  Decision  Tree  for  Controlling  Quality  by  Choosing  an  Optimal 
Maintenance  Action  in  an  Open  Loop  Control  Problem. 


3.1.1  Plausible  Forms  for  the  Loss  Functions  and  Densities 

A  realistic  evaluation  of  the  above  described  loss  functions  and  the  associated  probability 
densities  is  an  important  step  in  any  given  application  and  should  be  exercised  with  caution.  In  what 
follows,  we  suggest  some  plausible  forms  for  these. 

Let  c(i)  [c'(i)]  for  i  =  2,  •••,  £+1  be  the  cost  of  overhaul  during  interval  i  [the  cost  of  an 
unwarranted  overhaul  in  interval  i];  it  is  reasonable  to  suppose  that  {c(i)}  [{c'(i)}]  is  nondecreasing 
[nonincreasing].  Note  that  c'(i)  would  capture  the  consequences  of  tampering  with  production.  Finally 
let  an  exponent  c  describe  the  magnitude  of  the  loss  due  to  defective  quality  -  see  the  equations  below. 


6 


Then,  motivated  by  Taguchi’s  suggestion  of  quadratic  losses,  a  plausible  form  for  £.,  for  any  k  =  2,  3, 
•  •  •,  i  -  1,  and  i  =  2,  ■••,£  +  1,  is  i.j^(a(i),  9)  =  (0*  -  if  ^  <  9*,  and  i-[^(a(i),  9)  =Qif  9  >  9”. 

When  k  i,  we  would  have  £jj(a(i);  =  c(i' -i- Cj  •  (0*  —  +  C2  •  c'(i),  where  c,  =  1(0) 

if  ^1  <  (  >  )  9',  and  since  c'(i)  will  be  incurred  only  if  the  consequence  of  not  scheduling  maintenance 
would  be  deleterious,  C2  =  1(0)  if  >  (  <  )  9*. 

As  far  as  the  specification  of  the  needed  probability  densities,  we  note  that  for  any  k  =  i,  and 
i  =  2,  •••,  «+l 

Pk(^  I  a(i))=  ^  P(^i  <  0  I  a(i))  =  ^  P(-^i  W;  <  0  |  a(i))  =  ^  P(wi  <  9  |  a(i))  P^{9), 

since  the  effect  of  a(i)  is  to  make  fli-  =  1.  For  any  k  <  i,  and  k-2,---,i-l,  it  can  be  verified  -  see  A 1 
in  the  Appendix  —  that 

2  “  k  1 

Pk(^I^W)=  1  (ir:^(w)^-’^((l)^)-PiHdw,  (3.1) 

v/>& 

where  7r(  • )  is  the  prior  of  assumed  to  be  a  beta  density  with  parameters  p  and  q.  Specifically, 

=  0  </?<!•  (3-2) 

A  plausible  choice  for  Pi(w),  the  marginal  distribution  of  the  stationary  process  {wj^}  is  the 
uniform  density  over  some  interval  (a,  b),  where  0  <  a  <  b  <  1. 

To  specify  Pii(^i,  9-^  \  a(i)),  we  note  that  its  factorization  may  be  written  as  Pii(^i  |  a(i))  P^C^;) 
since  given  a(i),  9^  is  independent  of  9-^  and  9-^  is  independent  of  a(i).  Finally,  Pii(^i  I  a(i))  is  simply 
Pl(^),  and  Pii(^i)  is  given  by  (3.1)  with  the  index  i  replacing  the  index  k. 

4.  Controlling  Quality  by  Controlling  Input  and  Maintenance  Schedules 

In  this  section  we  will  consider  the  situation  in  which  the  output  quality  can  be  controlled  by 
both,  a  judicious  choice  of  input  quality  and  the  selection  of  an  optimal  maintenance  schedule. 

To  simplify  our  development,  suppose  that  the  input  quality  can  be  described  by  two 
stationary  stochastic  processes,  both  of  which  are  assumed  to  be  identical  in  all  respects  except  that  one 
has  mean  /i  and  the  other  has  mean  n'  with  n  >  n'.  Suppose  that  it  costs  an  additional  C  units  of 
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money  per  batch,  to  use  the  input  with  mean  Suppose  also,  that  when  a  production  cjcle  is  begun, 
the  input  quality  has  mean  n'-,  the  idea  here  is  that  a  good  state  of  machine  compensates  for  the  lower 
quality  of  input  and  that  maintenance  or  overhaul  will  not  take  place  unless  the  input  quabty  has  been 
switched  from  /i'  to  /i.  Finally,  suppose  that  the  input  quality  with  mean  fi  is  described  by  the  process 
{wj^}  and  that  with  mean  n'  is  described  by  the  process  {wj^}. 

In  what  follows,  we  shall  adopt  the  set-up  of  Section  3,  except  that  now,  during  the  first  time 
period,  we  neither  switch  the  input  quality  from  {w|^}  to  {wj^}  nor  undertake  maintenance.  During 
the  second  time  period,  we  are  not  allowed  to  schedule  maintenance  since  a  switch  in  input  quality 
must  precede  maintenance.  However,  during  the  second  time  period,  we  must  take  one  of  (  ^  ^ 

actions  a(s,  m),  where  a(s,  m)  denotes  the  action  to  switch  input  quality  from  at  the  s-th  time  period, 
and  to  schedule  maintenance  during  the  m-th  time  period  with  s  <  m,  s  =  2,  •  •  ■  ,  £  -f  1,  and  m  =  3,  ■  •  • 
,  g  -f  1;  note  that  s  =  m  only  when  both  are  i  +  h  Also,  a(£-fl,  i+l)  implies  that  we  need  not  switch 
input  quality  nor  schedule  maintenance  throughout  the  £  time  intervals.  We  shall  also  find  it 
convenient  to  introduce  the  notation  a(s,  m),  a(s,  m)  and  a(s,  ifi),  where  s  and  m  represent  the  actions 
of  switching  input  quality  after  time  interval  s  and  scheduling  maintenance  after  time  interval  m 

respectively. 


The  decision  tree  for  this  scenario  is  given  in  Figure  4.1;  much  of  the  notation  used  is 
analogous  to  that  of  Figure  3.1.  It  can  be  verified,  see  A2  in  the  Appendix,  that  for  any  m  >  s,  and 
m  =  3,  •••,£  +  1,  Pni(^  i  i  ^  ^  ^  ^  <  m,  P^{e  1  a(s,  m))  is 

given  by  the  right  hand  side  of  (3.1),  whereas  for  any  1  <  k  <  s  (  <  m),  it  is  given  by  (3.1)  with  the 
last  term  replaced  by  Pi(w).  A  plausible  choice  for  P'i(w),  is  a  uniform  density  over  (a-e,  b-e),  for 
some  e  >  0,  0  <  a  -  e  <  b  -  e  <  1.  The  quantity  P^^*(0s,  I  a(s,  m))  denotes  the  joint  density  function 
of  dg  (at  ^g)  and  6g  -  the  output  quality  of  batch  s  had  the  switch  in  input  quality  not  occurred  at 
batch  s  -  (at  e*).  Similarly,  Pim(^i-  ^m  I  »"))  function  of  9^  (at  ^j)  and 

9^  -  the  output  quality  of  batch  m  were  maintenance  not  undertaken  at  batch  m  -  (at  0jjj). 

Finally,  following  arguments  analogous  to  those  at  the  end  of  Section  3,  we  can  show  that 
P  ,^(0g,  0*  I  a(s,  m))  can  be  written  as 


{] 


w  > 


(s  -  l)w 


3  2  -  s 
wl 


(s  -  l)w 


Q*  2  ■ 


:r(($)s-l).p;(w)  dw}. 


yf>  6. 


and  Piin(^i’  ^m  i  ~  Pl(^i) ' 


1 


(m  —  l)w 


2  2  —  m  ,  2  _J_\ 


w  > 
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Our  next  step  is  to  specify,  for  each  combination  of  action  and  consequences,  the  loss  functions. 
In  specifying  these,  we  shall  follow  the  notation  and  the  cost  structure  of  Section  3.1.  Thus,  for  the 
production  during  any  period  prior  to  the  switch  in  input  quality  and  overhaul,  i.e.,  for  k  =  2,  •  ••  ,  s-1, 
s  =  2,  •••,£+  1,  s  <  m  =  3,  •■•,«  +  1,  the  loss  L'  is  given  as 

l,j^(a(s,  m),  Q)  =  (0*  -  if  and  i,j^(a(s,  m),  5)  =  0  if  0  >  B* . 

For  the  production  during  any  period  k  at  which  a  switch  in  input  quality  occurs,  that  is  when 
k  =  s,  s  =  2,  •••,£,  the  loss  i,  is  a  function  of  three  arguments,  the  index  s  represented  via  a(s,  m),  the 
state  of  nature  B^  =  8^  resulting  from  the  action  a(s,  m),  and  the  state  of  nature  Bg  =  action 

a(s,  m)  taken.  Note  that  6^  is  needed  to  capture  the  cost  of  an  unwarranted  switch  in  input  quality. 

Let  c*(s),  s  =  2,  ,  i,  denote  the  cost  of  an  unwarranted  switch  in  input  quality  during  the  interval  s, 

and  suppose  that  {c*(s)}  is  a  nonincreasing  sequence,  then 

i.^^*(a(s,m),  B^,  B;)  =  C  +  •  (B’-B^f  +  1{6;-B-)  ■  c*(s). 

where  I(x)  is  1(0)  if  x  >  (<)  0.  For  any  k  following  a  switch  in  input  quality  but  preceding  the  interval 
at  which  overhaul  is  undertaken,  that  is  for  k  =  s  +  1,  s  +  2,  •  ••  ,  m-1,  the  loss  i.  is  a  function  of  two 

arguments  a(s,  m)  and  8,  a  realization  of  s  =  2,  •••,  £,  m  =  3,  •••  ,  £  +  1,  so  that 

£ (^(a(s,  m),  9)  =  C  + 1(0*  -  B)  ■  {8’  -  Bf. 

Finally,  for  any  m  at  which  an  overhaul  occurs,  £  is  a  function  of  three  arguments,  the  index  m 
represented  via  the  action  a(s,  m),  the  state  of  nature  B^  resulting  from  action  a(s,  m)  (in  fact,  8^  is  lot 
quality  of  batch  m)  and  nature  were  action  a(s,  m)  taken.  Thus,  for  any  m  =  3,  ■  •  •  , 

£  +  1,  m  >  s, 


£jjjj(a(s,m), 

where  c(m)  and  c^(m)  are  as  described  in  Section  3.1.1. 

The  necessary  ingredients  to  compute  E(a(s,  m)),  the  expected  loss  (over  the  production  cycle 
of  length  (m  -  1))  resulting  from  action  a(s,  m)  are  in  place,  and  the  optimum  decision  is  to  choose 
that  action  for  which  E(a(s,  m))  or  E(a(s,  m))/(m— 1)  is  a  minimum. 
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Figure  4.1  Decision  Tree  for  Controlling  Quality  by  Switching  Input 
Quality  and  Choosing  an  Optimal  Maintenance  Action 


5.  An  Illustrative  Example 

As  an  illustration  of  our  approach,  suppose  that  the  Wj^’s  and  the  wj^’s  of  the  input  quality  are 
uniformly  distributed  over  (a,  b)  and  (a-e,  b-e)  respectively,  with  0  <  a-e  <  a  <  b-e  <  b  <  1;  let 
a  =  .9,  b  =  1  and  e  =  .1.  Suppose  that  the  coefficient  /?  of  (2.1)  has  the  beta  distribution  (3.2)  with 
p  =  22.5  and  q  =  2.5.  Finally,  suppose  that  C,  the  number  of  subintervals  is  15  and  6*  the  minimum 
acceptable  batch  quality  is  .75. 

Recall  that  is  the  state  of  the  machine  during  the  k-th  interval;  let  7rj^(y)  denote  the 
probability  density  of  ^  at  y,  for  0  <  y  <  1.  Then,  for  k  #  1,  it  can  be  shown  [see  A3  in  the  Appendix] 

that  _p _  1  a  _  1 

^k(y)  =  r(p  +  q)  •  yk  - 1  (1  -  yk  - 1)  /[(k  -  i)r(p)r(q)]. 
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For  our  choice  of  c(i),  the  cost  of  an  overhaul  during  interval  i,  we  choose  c(i)  = 
where  the  expectation  is  taken  with  respect  to  irj(y),  given  above.  Note  that  the  chosen  form  of  c(i) 
captures  the  deviation  of  0-  from  1,  the  perfect  state.  Regarding  our  choice  of  c'(i),  the  cost  of  an 
unwarranted  overhaul  in  interval  i,  we  choose  c'(i)  =  E{10  •  (0j  -  9*)"^  ■  l(0j  -  0*)},  where  I(x)  =  1(0)  if 
x>(<)0. 

This  choice  is  reasonable;  the  constant  10  is  an  arbitrarily  chosen  scaling  constant.  The  values 
of  c(i)  and  c'(i),  for  i  =  2,  3,  16,  are  given  in  Table  1.  Also  shown  there  are  values  of  E(a(i))  and 

E(a(i))/(i  -  1),  the  expected  loss  over  the  production  cycle  of  length  (i  - 1),  and  the  expected  loss  per 
interval  of  production  of  action  a(i).  It  is  clear  from  the  above  that  using  the  latter  criterion  we  would 
choose  to  schedule  maintenance  at  the  4-th  production  cycle. 

For  the  scenario  of  Section  4,  we  choose  C  =  .75  and  c*(s)  =  e  •  P(l9*  >  9*)\  the  other  constants 
are  defined  in  a  manner  analogous  to  those  of  the  scenario  of  Section  3.  The  necessary  details  are 
shown  in  Table  2,  from  which  it  can  be  seen  that  the  optimum  decision  is  action  a(3,  4),  i.e.  switch 
input  during  period  3  and  undertake  overhaul  during  period  4. 

6.  Conclusions 

It  is  apparent  from  the  above,  that  despite  the  simplicity  of  our  model  formulation,  the 
ensuing  development  is  detailed  and  fraught  with  much  notation.  All  the  same,  coherence  demands 
that  we  undertake  an  analysis  of  problems  of  this  type  in  the  manner  indicated  here.  Thus  it  appears 
that  improvisations  of  our  set-up,  aimed  towards  making  our  model  more  realistic,  would  lead  to 
complications  that  would  be  computationally  burdensome  to  manage.  Nonetheless,  it  is  our  hope  that 
such  difficulties  can  be  overcome  using  modern  numerical  and  simulation  techniques;  these  we  leave  to 
the  ingenuity  of  others.  In  the  meantime,  we  are  content  with  accepting  the  fact  that  the  contribution 
here  is  a  modest  one  and  that  its  chief  virtue  may  be  the  setting  up  of  a  framework  upon  which  future 
work  -  such  as  say  closed  loop  control,  etc.  -  can  be  built  upon. 
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Table  1 


Computations  for  Choosing  an  Optimal  Maintenance  Schedule 


Production 

Cycle 

i 

c(i) 

Cost  of 
Overhaul 
during  the 
i-th  Cycle 

c'(i) 

Cost  of  an 
Unwarranted 
Overhaul 
during  the 
i-th  Cycle 

E(a(i)) 

Expected  Loss 
in  choosing  a(i) 

E(a(i))/(i-l) 
Expected  Loss 
per  Interval 
of  Production 
in  choosing 
a(i) 

1 

2 

.01346159 

.1466078 

.16006939 

.1601 

3 

.04531247 

.06189097 

.10952019 

.0548 

4 

.08681184 

.03175586 

.1516 

.0505 

5 

.132768 

.01861726 

.2627288 

.0657 

6 

.1800835 

.01196662 

.4328089 

.0866 

7 

.2269232 

.00820868 

.6542068 

.1090 

8 

.2722247 

.00591129 

.9205668 

.1315 

9 

.3154032 

.00442179 

1.226507 

.1533 

10 

.3561711 

.00341007 

1.567454 

.1742 

11 

.3944248 

.0026873 

1.9395 

.1940 

12 

.4301732 

.00217836 

2.33934 

.2127 

13 

.4634929 

.00177852 

2.764051 

.2303 

14 

.4944989 

.00148416 

3.211187 

.2470 

15 

.5233261 

.0012476 

3.678556 

.2628 

16 

.5501175 

.000104743 

4.164261 

.2776 
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Table  2  Computations  for  Choosing  an  Optimal  Input-switching  and  Maintenance  Schedule 


s 

m 

c*(s) 

Cost  of  an 
Unwarranted 
Switch  in  Input 
Quality  during 
the  s-th  Cycle 

c(m) 
Cost  of 
Overhaul 
during  the 
m-th  Cycle 

c'(s) 

Cost  of  an 
Unwarranted 
Overhaul 
during  the 
m-th  Cycle 

E(a(s,m)) 
Expected 
Loss  in 
choosing 
a(s,m) 

E(a(s,m))/m-l 

Expected 

Loss  per 
Interval  of 
Production  in 
choosing 
a(s,m) 

3 

4 

.02139652 

.08681184 

.03175586 

.26180236 

.0873 

5 

.02139652 

.132768 

.01861726 

.44803108 

.1120 

6 

.02139652 

.1800835 

.01196662 

.69301114 

.1386 

7 

.02139652 

.2269232 

.008208675 

.98940910 

.1649 

8 

.02139652 

.2722247 

.005911289 

1.33076901 

.1901 

9 

.02139652 

.3154032 

.004421795 

1.71170882 

.2140 

10 

.02139652 

.3561711 

.003410068 

2.12765569 

.2364 

11 

.02139652 

.3944248 

.0026873 

2.57469262 

.2575 

12 

.02139652 

.4301732 

.002178363 

3.04954208 

.2772 

13 

.02139652 

.4634929 

.001778515 

3.54895858 

.2958 

14 

.02139652 

.4944989 

.001484155 

4.07138858 

.3132 

15 

.02139652 

.5233261 

.0012476 

4.61375822 

.3296 

16 

.02139652 

.5501175 

.001047427 

5.17446345 

.3450 

2 

4 

.04827556 

.08681184 

.003175586 

.32129528 

.1071 

3 

4 

.02139652 

.08681184 

.003175586 

.26180236 

.0873 
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APPENDIX 

A1  Derivation  of  the  Density  Function  Pj^(0  |  a(i)) 

Recall  that  Pi(^)  is  the  density  function  of  the  input  quality  at  the  point  9.  Then,  since  /?  and 
Wj^  are  independent  of  a(i),  for  k  =  1,  2,  •••,  i  —  1,  we  have 

Pk(«  I  a(i))  =  ^  ‘  »k  <  »  !  a(i))  =  ^  pcs'*  - '  -k  £  »)• 

Note  that  P(/3'' “ ‘w^  <  »)  =  |  PO'‘“  ■  <  I  Wk  =  ”) '  (^ '*"■  ^hetefote, 

all  w 


Pk(^|a(i))=^ 


1 

P(/3  <  (w)*'-^)  Pi(w)  dw  = 
vf>9  w>0 

A2  Derivation  of  the  Density  Function  Pj^(0  |  a(s,  m)) 

Obviously,  for  any  m  >  s,  and  m=3,  •••  ,  £-1-1,  Pjn(^  I  a(s,  m))  =  ^  P(wi  <  0)  =  Pi(^)- 

Therefore,  2  _  k  i 

P^{e  I  a(s,  m))  =  f  (w/ 


(k-1) 


2  —  k  1 

hrz  (w)^  "  ^  ■  Pi(w) 


d  ^  0\  -Dll 


v/>9 


(!)•'  -  ^  •  5r((f  )k  -  1)  •  Pi(w)  dw  for  any  s  <  k  <  m; 


Pj^(0  I  a(s,  m))= 


2  -k  1 

^ —  (|:)k  - 1 .  7r[(^)l^  - 1]  •  Pi(w)  dw  for  1  <  k  <  s  (  <  m). 


(k  —  l)w 


vr>9 

A.3.  Derivation  of  the  Formulae  in  Section  3.3 
1)  Derivation  of  the  density  of  d)^ 


Let  ir]^(y)  denote  the  density  of  Then,  since  ^  and  ir{f3)  is  a  beta  distribution 
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with  parameters  p  and  q,  we  have,  if  k  ^  1  and  0  <  y  <  I, 


^k(y)  = 


_J _ r(p  +  q) 

k  -  1  r(p)  r(q) 


-^-1  -5- 

.yk-1  (l_yk-l)q 


and  7rj^(y)  =  0,  o.w. 


When  k=l,  obviously,  P(«l>^  =  y)  =  1  if  y  =  1,  and  it  is  0  otherwise. 


2)  Derivation  of  {0  \  a(i)) 

Since  Pi(w),  the  density  of  Wj^,  is  a  Uniform(a,  b),  P]^(0  |  a(i))  =  ^  I  a(i)), 

and  the  density  of  4)^  is  as  shown  above,  it  is  obvious  that  Pi(0)  ~  Uniform(a,  b)  if  =  1. 

Therefore,  for  k=2,  3,  •••,  i  -  1,  with  the  parameter  p  >  k  -  1 


Pk(^|a(i))=- 


1  r(p  +  q) 
e/h^~^  (k-i)-r(p)  r(q) 

1  1  r(p  +  q) 


yk-i  \l_yk-i)q-i  dy,  if  0  <0<a, 

P 


yk-i  ^(1-yk-i)^"^  dy,  ifa<6l<b. 


^/b  b-a  (k-l)-r(p)  r(q) 


3)  Derivation  of  Pj^(0  |  a(s,  m)) 


Since  Pi(w),  the  density  of  Wj^,  is  uniformly  distributed  in  (a,  b)  C  (0,  1),  Pi(w'),  the  density 
of  Wj^,  is  uniformly  distributed  in  (a-e,  b  -e)  C  (0,  1),  P^i0  \  a(s,  m))  =  ^  P(^k  ^  ^  I  ^(®>  ^))’ 
the  density  of  is  shown  above,  by  the  same  procedure  for  showing  the  density  Pj^(0  |  a(i))  it  can  be 
proved  that  Pjn(^  I  a(s,  m))  =  Pi(^)  =  Pi(6’  |  a(s,  m))  is  uniformly  distributed  over  (a  -  e,  b  -  e)  C  (0, 1) 
if  4,^  =  4,^  =  1.  For  k  =  2,  ,  s-  1,  s  =  2,  •••  ,  s  <  m  (s  =  m  holds  only  if  s  =  m  =  l+l),  with 


p  >  k  -  1, 

Pk(^  1  a(s,  m))  = 


±_ 

a-e  I 


e_  h-a  (k - i)r(p)r(q) 

=  ^  b-e 


P(p  +  q)  ..k-i  ^(i-yk-i)q-i  dy,  if  0  <0  <a-e. 


1 


1 


J_b-a  (k  -  l)r(p)r(q) 

b-e 


p  1 

r(P  +  q)  yk  -  1  (1  _  yk  -  l^q  ~  1  dy,  ifa  —  e<0<b  —  e. 


Finally,  for  k  =  s,  •  •  •  ,  m  —  1,  with  p  >  k  —  1, 


P^{e  I  a(s,  m))  = 


.9 /a  ^ 

■  9/h^~^ 


^  6lh'°  ^ 


_ "bq) _  k-i  ^(1 -yk-i)‘^~^  dy, 

(k-i)r(p)r(q)y  I  y  1  y. 

_ _ yk^”^l_yk^)q-i  dy, 

(k-i)r(p)r(q)^  u  y  1  y, 


if  0  <  ^  <  a. 


if  a  <  0  <  b. 
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